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This publication consists of two parts: 


@ Resource Flows for Health Research and Development: A Comparative 
Study of Malaysia, the Philippines, and Thailand; and 


@ A Manual on Tracking Country Resource Flows for Health Research and 
Development 


It is the result of a two-year multi-country study that responded to various moves in 
the health sector environment: the early 1990s call of the Commission on Health Research 
and Development recommending that all countries should vigorously undertake essential 
national health research (ENHR) to accelerate health action in diverse national and com- 
munity settings, and to ensure that resources available for the health sector, achieve maxi- 
mum results; the 1996 World Health Organization (WHO) declaration for the need for a 
mechanism for exchanging ideas about progress and priorities in health R&D, and for 
tracking flows of funding as well as identifying important gaps; and a subsequent paper at 
the First Global Forum for Health Research pointing out the need to collect, analyze, and 
disseminate information on health resource flows to better address health problems of low 
and middle income countries. 


The first part is the integrated report that culls from the parallel efforts of the partici- 
pating countries of Malaysia, the Philippines, and Thailand. It draws from the individual, 
more detailed country studies and highlights the data that can be compared across them. 
Findings on the tracking of health R&D resource flows of the three countries are presented. 
The multicountry report takes off from a Philippine report on health R&D flows funded by 
the Department of Health. 


The second part is the manual that presents the method used by the three countries 
to track their respective health R&D resource. It is addressed to other countries that would 
like to embark on a similar effort. As such, it explains the different steps involved. Every 
attempt is made to simplify and make the steps as straightforward as possible. Whenever 
needed, potential areas of difficulty are identified; and whenever applicable, solutions of 
the three countries to these difficulties are discussed. 
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PART ONE : 


RESOURCE FLOWS FOR 
HEALTH RESEARCH 
AND 
DEVELOPMENT 


A Comparative Study of Malaysia, the Philippines, and Thailand 


a 
BACKGROUND 


eee 


In the early 1990s, the Commission 
for Health Research and Development 
(Commission) published a report recom- 
mending that all countries should vigor- 
ously undertake essential national health 
research (ENHR) to accelerate health ac- 
tion in diverse national and community 
settings, and to ensure that resources avail- 
able for the health sector, achieve maxi- 
mum results. The recommendation was 
particularly directed to developing coun- 
tries where ENHR could, among other 
things, enhance the impact of limited re- 
sources. 


Within the decade the World Health 
Organization (WHO) published the report, 
Investing in Health (1996) which noted re- 
lated findings: the need for a’ mechanism 
for exchanging ideas about progress and 
priorities in health research and develop- 
ment (R&D), and for tracking flows of fund- 
ing and identifying important gaps. The fol- 
lowing year, a paper presented at the First 
Global Forum for Health Research pointed 
out the need to collect, analyze, and dis- 
seminate information on health resource 
flows to better address health problems of 
low and middle income countries. 


OBJECTIVES 


LL, 


This study is a first attempt at re- 
sponding to the concerns raised so far 
about the tracking of health R&D funds as 
it looks at these resource flows in three 
middle income countries: Malaysia, the 
Philippines, and Thailand. Its overall ob- 
jective is to develop a basic methodology 
for tracing and measuring health R&D 
funds in a country as a tool to streamline 
and finetune the allocation of health R&D 
funds. 


The specific objectives, at the coun- 
try level, are: 


e To identify the sources, users, 


and uses of health R&D funds 


To estimate the amount and 
nature of health R&D expendi- 
tures 


e To undertake a qualitative analy- 
sis of research outputs resulting 
from these resources, to the ex- 
tent possible 


e To assess if health R&D expendi- 
tures are aligned with the priori- 
ties of the research agenda 


e To catalog indicators for moni- 
toring health R&D expenditures 
across time 


This report presents an integrated 
view of the resulting work carried out in the 
three countries. As such, it highlights the 
data that can be compared across them. 
Through their experiences, it also shows how 
such a methodology is of use and can be 
applied to other countries. 
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Nee ee 
APPROACH and METHODOLOGY 


To track the flow of funds for health 
R&D, an accounting framework which 
traces the flow of funds from fund sources 
to fund users is used, the latter referring 
mainly to funding recipients tasked to un- 
dertake the R&D activity. 


Several constructs underpin this 
flow of funds framework. 


First is the definition of health R&D, 
a critical construct, since such a definition 
not only determines the scope of the pro- 
posed project effort but also guides the task 
of tracing the flow of funds, particularly in 
cases where the funds take a rather convo- 
luted track (e.g. when multilateral funding 
goes through the government budgetary 
process before a research institution is al- 
lowed access to it.) For purposes of the 
project, a modified version of the United 
Nations Educational, Scientific, and Cul- 
tural Organization (UNESCO) definition of 
R&D is used. Health R&D is defined as “any 
systematic and creative work undertaken 
in order to increase the stock of knowledge 
of health, and the use of such knowledge 
to devise new applications.” Thus, the defi- 
nition covers all R&D work falling within the 
domain of the medical and natural sci- 
ences, studies on health financing and eco- 
nomics, as well as sociological studies such 
as studies on knowledge, attitudes, and 
practices (KAP) of people towards health 
programs and interventions. 


Second are the categories used to 
capture fund sources and fund users in the 
framework. The major fund sources are the 
three categories of public funds (emanat- 
ing from government budgets, user fees 
and social insurance), private funds 
(sourced from pharmaceutical companies, 
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health care providers, and non-government 
organizations (NGOs)/foundations), and 
foreign funds from bilateral and multilat- 
eral agencies. The institutional breakdown 
of fund sources is guided as much by their 
source of financing (e.g. government bud- 
get versus user fee) as their functional role 
(e.g. public vs. private, providers vs. phar- 
maceutical firms). On the other hand, the 
major fund users are government agencies, 
academic institutions, research institutions, 
NGOs/foundations, pharmaceutical com- 
panies, and health care providers. Although 
these institutions are viewed as the main 
players and stakeholders in the health re- 
search arena of the three countries consid- 
ered, they break out differently for each 
country at the tirm and agency level with 
the possibility of some overlapping. The is- 
sue of double counting should therefore not 
be viewed as trivial. 


Third is the structure within a coun- 
try that theoretically brings together health 
R&D sources with health R&D users so that 
funding is efficiently brought to bear on the 
most critical health research priority areas. 
This structure usually consists of both public 
and private organizations with relevant 
mandates, stakeholders, and the larger 
community. Within this structure have 
evolved both informal and formal linkages 
that shape the process of formulating poli- 
cies related to the country’s health research 
agenda. The project sheds light on whether 
the funding of health R&D is in any way re- 
sponsive to the policies formulated. 


Fourth are the techniques for data 
generation and statistical analysis. Data 
generation is country-specific and is guided 
by the funds flow framework. The strategy 
for carrying this out consists of four elements: 


e A systematic and comprehensive 
review of existing relevant data 
sets in order to determine their 
utility as a source of information 
for the project and to identify in- 
formation gaps. 


e Building a respondent base in the 
absence of a comprehensive or 
universal list of sources and us- 
ers of health R&D funds through 
a purposive sampling approach 


e A survey of pertinent respondents 
through a mail questionnaire 
supported by telephone and/or 
personal interviews in order to fill 
up the information gaps, plus sta- 


tistical analysis of survey data us- 
ing Excel spreadsheets and uni- 
form templates. 


e Coordination mechanism of 


project meetings, timed with key 
deliverable milestones to bring 
together key members of the 
country project teams in order to 


‘discuss and decide on common 


plans of action for the project, 
share respective country findings, 
and enhance networking. 
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COUNTRY FINDINGS 


made of some country-specific findings. A 
full account of all results is presented in the 
‘adividual country reports submitted to the 
Council on Health Research for Develop- 
ment (COHRED). 


This section presents an inte- 
grated view of the results of the study car- 
ried out in each of the three countries. The 
results shown therefore lean towards those 
which would yield a meaningful compari- 
son across countries, although mention Is 


Flow-of Funds Framework 


All three countries tracked the used to capture fund sources and fund us- 
flow of funds for health R&D by tracing the ers in the framework. Sources of funds are 
flow from the fund sources to fund users. classified into three types: government bud- 
The users are mainly funding recipients get; private sector; and foreign funding 
tasked to undertake the R&D activity. agencies (bilateral or multilateral). There 

are only two categories for fund users: gov- 

Table 1 presents the categories ernment sector and private sector. 


Table 1. Framework and Categories for Flow of Funds 
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Table 1. Framework and Categories for Flow of Funds (continued) 


SOURCES 
(continued) 


USERS 


MALAYSIA 


Bilateral Agencies 
CIDA 


Government Sector 


« Ministry of Health 

e Ministry of Science; 
Technology & Environ- 
ment 

e Ministry of Primary 
Industry 

e Ministry of Agriculture 

e Academic/Research 

Institutions 


Private Sector 


« Pharmaceutical 
Firms ; 

« Academic/Research 
Institutions 


PHILIPPINES 


Bilateral Agencies 


AusAID 

EU 

German Development 
Cooperation 

IDRC 

Israeli Government 

JICA 

Royal Netherlands 

Embassy 

SNV 

USAID 


Government Sector 


e Department of 
Health 

e Department of 
Science and 
Technology 

e Department of 
Education, 
Culture and 
Sports 
Research Institu- 


° Pharmaceutical 
Firms 
e Academic/Research | 
Institutions 


THAILAND 


Bilateral Agencies 


AusAID 
EU 
JICA 
USAID 


‘Government Sector 


@ Ministry of Public 
Health 
e Ministry of Science 
e Ministry of Education 
~@ Ministry of University 


e Aca demic/Research 


se ‘Hospitals/Health 
te - Care Providers 
NGOs 


e Hospitals/Health 
Care Providers 
e NGOs ; 


« Hospitals/Health. 
Care Providers — 


Sources: COHRED-MOH Health Research Resource Flows Survey, Malaysia, 2000. 
COHRED-CEPR Health Research Resource Flows Survey, Philippines, 2000. 
COHRED-Chulalongkorn University Health Research Resource Flows Survey, Thailand, 2000. 
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The table brings out the follow- 
ing patterns in source and user categories 
for health R&D in the three countries: 


e The government budget is a source 
of funds in all three countries. 


e Only Malaysia cites a single finan- 
cial institution as a private sector 
funder. In the Philippines, private 
sector funds are sourced both from 
local and foreign institutions. 


e Local-non-government organiza- 
tions emerged as a major fund 
source in Malaysia and Thailand, 
while they are merely a funding re- 


The relative absence of secondary 
data on health R&D financing mandated 
the collection of primary data. A common 
survey instrument using as a basis the 
UNESCO definition for R&D was formu- 
lated and agreed upon to ensure compa- 
rability of data across countries. 


The pioneering nature of the effort 
coupled by the time and resource con- 
straints imposed on it made it necessary 
to adopt innovative strategies in building 
a respondent base. In the absence of a 
comprehensive or universal list of sources 
and users of health R&D funds, all three 
country teams used a purposive sampling 
approach. The respondents in each coun- 
try were identified with the help of lists com- 
piled by major stakeholders such as the 
Ministry/Department of Health and Sci- 
ence and Technology. For the private sec- 
tor, most of the target respondents were 
those identified by government line agen- 
cies as grant recipients. Another method 
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cipient in the Philippines. 


e Government sector users consist of 
the main government line agencies 
for public health, science and tech- 
nology, education, academic/re- 
search institutions, and hospitals. The 
research institutions under the Minis- 
tries of Primary Industry and Agricul- 
ture are also fund users in Malaysia. 


e Private sector users consist mainly of 
pharmaceutical firms, academic/re- 
search institutions, and hospitals or 
health care providers. 


Respondent Base 


used in targeting respondents was to look 
at the top players of private sector groups 
such as pharmaceutical industry associa- 
tions. In the Philippines, for instance, thirty 
pharmaceutical firm-respondents were 
culled from the list of the top 7000 corpo- 
rations in the country for the first funds flow 
study. These approaches may have failed 
to pick up institutions without linkages with 
the government agencies, as well as orga- 
nizations that are not top listed in industry 
groupings. 


Questionnaires were sent by mail 
and followed up with telephone calls. 
Whenever time and resources permitted, 
some respondents were also visited, particu- 
larly those who accounted for large amounts 
of health research funding. In Thailand, a 
workshop was held among key players in 
health research. During this workshop, par- 
ticipants identified potential respondents. 


The relatively high response rates in 


SS lt 
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the government sector can mainly be at- 
tributed to the government support which 
the research effort received. This invariably 
led to increased access to and a higher 
level of cooperation from potential gov- 
ernment respondents. For instance, in 
Malaysia and the Philippines, the covering 
letter for the survey was signed by a high 
ranking official of the Ministry of Health. 


Table 2 below summarizes the num- 
ber of institutions surveyed and the response 
rates across countries. The Philippines had 
the highest response rate for the government 
sector at 91 percent while Malaysia in turn 
had the highest for the private sector at 88 
percent. Thailand reported a 100 percent 


response rate for bilateral/multilateral 
funders. 


Table 2. Respondent Base and Response Rates, 1998 Survey on Health Research Resource Flows 


Sources: COHRED-MOH Health Research Resource Flows Survey, Malaysia, 2000. 
COHRED-CEPR Health Research Resource Flows Survey, Philippines, 2000. . 
COHRED-Chulalongkorn University Health Research Resource Flows Survey, Thailand, 2000. 


Sources of Health R&D Funds 


The survey questionnaire asked the 
respondents to indicate whether they were 
fund sources, users, or both. The responses 
of those who identified themselves as fund 


sources are summarized in Table 3. 


The government sector was consis- 


tently the largest contributor to health R&D 


Part One: A Comparative Study of Malaysia, the Philippines and Thailand 
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funding in 1997 and 1998 for all three 
countries. The Ministry/Department of Sci- 
ence and Technology was the largest fund 
source in both Malaysia and the Philip- 
pines; for Thailand, it was the Ministry of 
Health. Private institutions provided less 
than 20 percent of funds although the rela- 
tive size of their contribution may partly be 
attributed to the sampling design. Thus, 
one should interpret the results with cau- 
tion as the purposive sampling approach 
used may have resulted in a bias for the 
government sector, thus decreasing the re- 
liability of making extrapolations to the 
universe of players and stakeholders. 


The share of government funding 


in Thailand remained constant for 1997 and 
1998 at 73 percent. But in terms of abso- 
lute amount, total research funding (espe- 
cially Government) actually increased. In 
the two other countries, this share decreased 
slightly from 1997 to 1998, with the phar- 


maceutical sector largely taking up the 
slack. 


The importance attached to health 
R&D is put in proper perspective by looking 
at government resources devoted to health 
R&D as a proportion of the health budget, 
the total government budget, and the 
country’s gross domestic product. These 
figures are presented in Table 4. 


Table 4. Government Health R & D Resources as a Percentage of Government Budget, Health 
Budget & Gross Domestic Product (GDP) 


Sources: 


COHRED-MOH Health Research Resource Flows Survey, Malaysia, 2000. 


| Appropriations Act, Philippines, 1997 and 1998. 
Res pa on R&D Expenditure and Personnel of Thailand, Thai Research Council, 1996-98. 
Seventh and Eighth National Economic and Social Development Plan, Thailand. 
inistry of Public Health Annual Report, Thailand, 1996-98. . 
SURED ChIGERECa University Health Research Resource Flows Survey, Thailand, 2000. 


1/ Health R&D resources based on amount spent and not amount given 
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1] 


The figures reveal that despite the 
fact that for all three countries, the govern- 
ment sector is the highest contributor to 
health R&D funds, health R&D in fact does 
not appear to enjoy a very high priority in 
resource and budget allocation. As a per- 
centage of total government budget, it 


The above analysis of fund sources 
and the relative amounts that they provide 
make it important to look at fund users and 
the areas to which the funds are applied. 
Table 5, summarizes the responses of those 
who categorized themselves as users of 
health R&D funds. In the same manner that 
it emerged as the dominant provider of 
funds, the government sector also came out 
as the dominant user. Among the govern- 
ment users, academic and research insti- 
tutions were the largest in Malaysia and 
the Philippines while the Ministry of Health 
occupied a similar slot in Thailand. 


Government users in Malaysia and 
Thailand were generally confined to the 


Users and Their Use Allocation of Health R&D Funds 


ranges from only 0.04 percent to 0.11 per- 
cent while as a percentage of the health 
budget, it ranges from only 0.60 percent to 
0.90 percent. As a percentage of GDP. the 
corresponding range is from 0.01 percent 


to 0.05 percent. 


Ministry/Department of Health and aca- 
demic/research institutions. The Philippines, 
on the other hand, had more diverse gov- 
ernment users, including the Department of 
Science and Technology and government 
hospitals. 


In Thailand, the government sector 
accounted for the same usage share of 
health R&D funds in 1997 and 1998 at 78 
percent. For Malaysia and the Philippines, 
on the other hand, government share de- 
creased slightly from higher shares of 88 
percent and 86 percent, respectively, in 
1997 to 1998 figures of 85 percent for the 
two countries. 
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Part One: A Comparative Study of Malaysia, the Philippines and Thailand 


In Table 6, fund uses in 1998 are presented e natural sciences: involves the 
by type of research and by aggregate treatment of natural phenom- 
health areas. R&D by type of research is enon like biology, botany, 
classified into three: chemistry, physics, and other 


e basic or fundamental re- 
search: any experimental or 
theoretical work undertaken 
primarily to acquire new 
knowledge of the underlying 
foundations or phenomena 
and observable facts, without 
any particular or specific ap- 
plication in view 

applied research: any origi- 
nal investigation undertaken 
in order to acquire new knowl- 
edge, but directed primarily 
towards a specific practical 
aim or objective, and 
experimental development: 
any systematic work that draws 
on existing knowledge gained 
from research and/or practi- 
cal experience and is directed 
to producing new materials, 
products and devices; install- 
ing new processes, systems 
and services; and substantially 
improving those already pro- 
duced or installed. 


related fields as related to 
health 

° medical sciences: includes 
epidemiological, clinical, and 
biomedical research in the 
following fields of study: 
anatomy, dentistry, medicine, 
nursing, obstetrics, optometry, 
osteopathy, pharmacy, phys- 
iotherapy, public health, and 
other allied subjects, and 

e health economics/social sci- 
ences: includes health-re- 
lated research in the social sci- 
ences such as health econom- 
ics, research on knowledge, 
attitudes, and practices of 
people towards health pro- 
grams and interventions, etc. 


For all three countries, Table 6 shows 
that applied research and research in the 
medical sciences received the highest fund- 
ing levels in 1998. For Malaysia, the shares 
were 63 percent and 94 percent respec- 
tively; for the Philippines, 70 percent and 
80 percent; and for Thailand, 72 percent 
and 62 percent. 


R&D by aggregate health areas is classi- 
fied into: 
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Part One: A Comparative Study of Malaysia, the Philippines and Thailand 


Health Research Resource Flows 


One advantage of the fund ac- 
counting framework used in this study is that 
it permits the tracking of the flow of funds 
from the source, through the conduit 


2 Figure 1. i 


agency (if any) and finally to the user. Three 
funds flow diagrams are presented to give 
a flavor of the information which such an 
exercise yields. 


Resource Flow for Health R&D 
Pharmaceutical Firms, Malaysia, 1998 
n=14 


SOURCES 


Pharmaceutical 
Firms 
(own funds) 


95% 


_USERS 


Pharmaceutical Firms 
79% 


Type or R&D Activi 


Basic Research 1% 
Applied Research 3% 
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Health R&D Resources 
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Figure 1.1 shows that in 1998, the 
pharmaceutical sector in Malaysia sourced 
its funds for health R&D internally, account- 
ing for 95 percent of the total. The remain- 
ing 5 percent came from the freign-based 
headquarters of surveyed pharmaceutical 
firms. However, the list of users was more 
diverse. Although pharmaceutical firms 
again received the lion’s share at 79 per- 
cent, some funds were also directed to gov- 
ernment academic/research institutions 
(11 percent), Ministry of Health hospitals 
(8 percent) and private hospitals (2 per- 
cent). Research is performed by various 


types of institutions. Market competition 
and bottomline concerns may have led 
pharmaceutical firms in Malaysia to use 
their own funds to perform experimental de- 
velopment research in the medical sciences. 
These are essentially the local pharmaceu- 
tical companies that carry out research on 
product and formulation development. 
However, the multinational pharmaceutical 
companies mostly subcontract their research 
to hospitals and government academic and 
research institutions, primarily for the con- 
duct of clinical trials. 
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On the other hand, the Department 
of Health (DOH) in the Philippines ob- 
tained research funding from different 
sources in 1998. As shown in Figure 1.2, 
the DOH and bilateral/multilateral agen- 
cies contributed close to equal shares at 
47 percent and 44 percent respectively. 
The other funds were brought in by other 
DOH units at 9 percent. This refers to DOH 
units that provided health R&D funds to sur- 
veyed DOH units. Smaller contributions 


were made by Department of Science and 
Technology and other government institu- 
tions. In terms of use, the DOH got the big- 
gest share at 40 percent. It then proceeded 
to subcontract to other sectors/institutions, 
as evidenced by the NGO share of 25 per- 
cent, private academic/research institutions’ 
share of 16 percent, and government hos- 
pitals’ share of 12 percent. 


Resource Flow for Health R&D 
Department of Health (DOH), Philippines, 1998 


n=36 
SOURCES USERS 
DOST 
0.6% 
DOH DOH 
47% 40% 
Other DOH Units ye 
i?) 
9% Research 
Institutions 
3% 
DOST 
0.14% Government 
DOH Health R&D Hospitals 
Resources 12% 
Bilateral/Multilat- (‘000 US$) 
oe Funding Amount Received: 1,727 Other 
a Project Funds: 1,107 Government 
6 Institutions 
4% 
Other 
Government Bic 
Institutions poi 
0.35% esearch 
Institutions 
16% 
NGOs 
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Source: COHRED-CEPR Health Research Resource Flows Survey, 


Philippines, 2000. 
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In Thailand’s NGO sector for 1998, search institutions were a major recipient, 
NGOs were a major source of health R&D getting 69 percent of funds while NGOs and 


funds, accounting for 48 percent of total the Ministry of Public Health enjoyed almost 
sources. Bilateral/multilateral funds pro- equal shares at 15 percent and 14 percent 
vided another 29 percent followed by gov- respectively. 


ernment funds at 21 percent. In terms of 
users, public and private academic/re- 


Resource Flow for Health R&D 
Non-Government Organizations (NGOs) 
Thailand, 1998 


n=21 
SOURCES USERS 
NGOs Public and Private 
(own funds) Academic/Research 
48% Institutions 
69% 
Government 
Funds ae : 
21% Ministry o 
NGOs Health R&D Public Health 
Resources 14% 
Private —b (‘000° US$) ee 
Institutions Amount Utilized: 315 
3% NGOs 
15% 
Bilateral/ 
Multilateral Private Institutions 
Funding 3% 
Institutions 
29% 


Source: COHRED-Chulalongkorn University Health Research Resource Flows Survey, Thailand, 2000. 
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Alignment of Health Research Funding with Health Priorities 


the priority-setting process in each of the 


A major objective of the study is to 
countries is discussed. 


compare the resulting allocation of health 
R&D funds with national health research pri- 
orities. To put the results of this exercise in 
proper perspective, a brief description of 


Health research priorities are de- 


Institutional Framework and Research Priority Setting Process 


MALAYSIA 


Institutional Framework for the Malaysian Health R&D Agenda 
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Government policy and 


Supply Factors 
objectives 


Professional Interests Morbidity, mortality patterns 


Research Capacity és 
Private Market forces 


Existing Knowledge National Bes institutions 
Priority Peas riorities 
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fined by two government bodies: the Na- 
tional Council for Scientific Research and 
Development (NCSRD) and the Standing 
Committee for Medical Research (SCMR) 
of the Ministry of Health (MOH). Both bod- 
ies formulate their respective research 
agendas through similar consultative pro- 
cesses with direct and indirect inputs from 
public research institutions, academic in- 
stitutions, and private organizations. The 
private sector, while undertaking a substan- 
tial amount of research, generally follows 
the priorities set by their respective institu- 
tions. Figure 2.1 illustrates the institutional 
framework for the health R&D agenda-set- 
ting process in Malaysia. 


National Council for Scientific Re- 
search and Development 


The NCSRD was set up by the Ma- 
laysian Government in 1975 as an advi- 
sory council specifically to oversee public 
sector research so that research resources 
are directed at enhancing the national de- 
velopment objectives. The Council is 
chaired by the Chief Secretary to the Gov- 
ernment and its members comprise of 
eminent science and technology (S&T) ex- 
perts from industry, academe, public re- 
search institutes, universities, and key gov- 
ernment agencies. The Council advises the 
government specifically the Minister of Sci- 
ence, Technology and the Environment on 
all matters relating to S&T, including the 
formulation of S&T policies; identification 
of S&T priorities; and the coordination, 
implementation, and evaluation of S&T 
programmes. The Council is assisted by 
two committees: the Standing Committee 
on Science and Technology Development 
and Management, and the Coordinating 
Committee on Intensification of Research 
in Priority Areas (IRPA) for its effective func- 
tioning. These two committees are further 
assisted by eight Working Groups and 11 


IRPA Panels, one of which is the IRPA Panel 
for the Health Sector. 


Standing Committee for Medical Re- 
search, Ministry of Health 


The Standing Committee for Medi- 
cal Research (SCMR) chaired by the Direc- 
tor-General of Health Malaysia is charged 
with the responsibility of managing the re- 
search activity and programs of the Minis- 
try of Health. The members of the SCMR 
comprise of the Deputy Secretary-General 
of Health (Finance), the three Deputy Direc- 
tor-Generals of Health, and senior Program 
Directors of the MOH. It has the mandate 
to plan, organize, and monitor the devel- 
opment of research facilities and research 
expertise; assist in obtaining research funds; 
and ensure the proper dissemination and 
utilization of research findings. The Stand- 
ing Committee also serves as liaison be- 
tween the Ministry of Health and other na- 
tional as well as international agencies in 
matters pertaining to health research. 


Priority setting in health is institution- 
alized as part of the planning process lead- 
ing to the formulation of five-year national 
plans. This started with the Fifth Malaysia 
Plan (1986-1990) which initiated the inte- 
gration of technology and science planning 
into the national planning process. This was 
accompanied by the creation of the Inten- 
sification of Research in Priority Areas (IRPA) 
fund, which is a central fund specifically for 
Research and Development. Efforts to es- 
tablish priorities in health research in Ma- 
laysia have since been made through the 
framework of the National Council for Sci- 
entific Research and Development (NCSRD) 
and the IRPA Panel for the Health Sector. 


A comprehensive guideline for prior- 
ity setting in health research was formulated 
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by the IRPA panel for health research and 
is embodied in a document titled, “Prior- 
ity Areas for Medical/Health Research”. 
This document was circulated for use com- 
mencing with the 1991 IRPA funding exer- 
cise. It specifies that each area for research 
be evaluated and ranked according to the 
following parameters: 


= Its socio-economic implica- 
tions - the extent of the prob- 
lem 

» Lack of information on the 
subject 

= Operational weaknesses 

= Cost and time needed for re- 
search 


A third revision of the priority list- 
ing was carried out in 1995 in prepara- 
tion for the Seventh Malaysia Plan (1996- 
2000). The revised document was the 
product of a “National Conference on the 
Setting of Research Priorities for the Medi- 
cal Sector for the Seventh Malaysia Plan”. 


Inputs for this conference were invited from 
as wide a representation as possible of or- 
ganizations which had an interest and/or 
are working in health research in Malaysia. 
This list of priorities is not meant fo be static 
and will evolve with changing national needs 
and aspirations. The national priority set- 
ting exercise Is conducted for each of the 
five-year development plans. 


In addition to the national research 
priority areas, research needs in the Minis- 
try of Health are also identified from the re- 
search dialogue sessions held annually be- 
tween researchers and the Ministry of 
Health’s policy makers, planners, and man- 
agers. The dialogue sessions provide a fo- 
rum where researchers are told of the latter’s 
research needs and expectations. Research 
needs are also identified through monitor- 
ing of the health data obtained from the 
National Health and Morbidity Survey con- 
ducted every ten years and from the Health 
Management Information System. 
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In general, government-funded 
health research in the Philippines attempts 
to address priority issues confronting the 
local health sector. In the case of the pub- 
lic health sub-sector, research priorities are 
defined by two government institutions: the 
Philippine Council for Health Research and 
Development (PCHRD) of the Department 
of Science and Technology (DOST), and the 
Essential National Health Research (ENHR) 
unit of the Department of Health (DOH). 
Both institutions formulate their respective 


aes e 2. 


LIPPINES 


feidesteel = 


health research agendas through similar but 
distinct consultative processes. A substan- 
tial amount of research is also funded by 
the private sector, which may not necessar- 
ily follow the priorities set by ENHR or 
PCHRD. Taken together, the private and gov- 
ernment sector priorities for research con- 
stitute the country’s research agenda for any 
given time period. The following figure il- 
lustrates the institutional framework for the 
health R & D agenda-setting process in the 
Philippines: 


Institutional Framework for the Philippine Health R&D Agenda 


DOH, DOST 


(STCC & PCHRD) 


Supply Factors 


‘ ae 
a aon 
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Source: DOH-CEPR 1998 Survey 
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Philippine Council for Health Re- 
search and Development 


The PCHRD is one of five sectoral 
councils of the Department of Science and 
Technology (DOST) and is the highest 
policy-making body in health research. 
One of its many roles is to provide leader- 
ship and direction in health-related re- 
search and development activities and to 
rationalize investment in science and tech- 
nology relating to health. It undertakes 
these functions through a system of review 
of ongoing and pipeline projects in the 
government sector and by exerting its in- 
fluence on the private sector, to ensure that 
implemented projects are in consonance 
with the National Health Research Agenda 
(NHRA). 


The NHRA is embodied in the Na- 
tional Health S & T Plan (NHSTP), which is 
drawn up every five years through a na- 
tionwide multi-sectoral consultation pro- 
cess spearheaded by the PCHRD. The pro- 
cess employs the bottom-up approach, 
and consultation is done at three levels: 
regional, zonal and national. With the 
NHRA in place, the PCHRD then reviews 
and evaluates health projects to determine 
the extent to which these are aligned with 
NHRA priorities, and to ensure that projects 


are complementary and do not duplicate 
each other. 


Essential National Health Research 
Unit 


The Essential National Health Re- 
search Unit of the DOH was created in 
1990 to manage the ENHR program of the 
DOH. This unit works closely with DOH 


regional R&D coordinators in organizing 


ENHR promotional activities in the prov- 
inces and regions through the local health 
networks. 


The goal of the ENHR program is to 
promote a scientific and data-based culture 
within the health sector as a means of el- 
evating the health status and quality of life 
of Filipinos. Part of its guiding policies Is to 
build up, support, coordinate and sustain 
health research activities, whose results 
serve as an input to the national public 
health plans and programs. Its health re- 
search priorities are defined through a pro- 
cess that involves consultations and work- 
shops with researchers, policymakers, pro- 
gram managers, health service providers, 
and users. The research agenda addresses 
the five main areas of responsibility of the 
DOH, namely: 


e Health sector organization 

e Disease control and pub- 
lic health 

e Personal health care 

e Health care financing, 
and 

e Health product develop- 
ment. 


These priorities were arrived at us- 
ing criteria which included burden of illness, 
perceived demand, urgency, feasibility, and 
impact. 
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Three government institutions (Na- 
tional Research Council of Thailand 
(NRCT), Ministry of Public Health (MOPH) 
and National Science and Technology De- 
velopment Agency (NSTDA)) and four au- 
tonomous research funding organizations 
(Health System Research Institute (HSRI), 
Thai Research Fund (TRF), Thai Health Re- 
search Institute (THRI) and Ananthamahidol 
Foundation) act as a core group to define 
health research priorities for the country. 


These institutions and organizations formu- 
late their health research agendas based 
upon the National Health Plan which is a 
sub-plan of the National Economic and 
Social Development Plan and through 
meetings which take place once a year at 
the Thai Forum on Health Research and 
Development. 


Research funded by the private sector 
(manufacturers of drugs, etc.) or interna- 


tional organizations (WHO, UNDP etc.) may 


Figoee 


Institutional Framework for Thailand Health R&D Agenda 
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not necessarily follow the same agenda as 
the government. The research priorities for 
this group reflect the needs of each orga- 
nization but occasionally coincide with the 
nation’s health research agenda since 
some members of this group are partici- 
pants in the Thai Forum on Health Research 
and Development. 


The figure illustrates the institu- 
tional framework for the health research 
and development agenda in Thailand. 


Although seven health and health 
related research institutions play major 
roles in setting priorities for health research 


Fund Allocation Analysis 


The survey results allow an 
analysis of the fund allocation pattern for 
the year 1998 in each country vis-a-vis the 
national health research priorities formu- 


e Table 7a shows good alignment 
of Malaysia’s 1998 health R&D 
funds with national health re- 
search priorities with 96 percent 
of funds going to the eight na- 
tional research priority areas for 
the medical sector in the Seventh 
Malaysia Plan. A third of R&D 
expenditures supported research 
on health problems associated 
with lifestyles while four other pri- 
orities enjoyed double digit 
shares of the funds: new technolo- 
gies in health/medical biotech- 
nology (17 percent), health care 
system and industries (15 percent), 
vector-borne and other commu- 


and development in Thailand, the process 
is led by the National Research Council. It 
is the highest policymaking body in re- 
search and development and consists of ten 
departments. The Medical Science Depart- 
ment is responsible for formulating the Na- 
tional Health Plan and Development activi- 
ties in health related research, including 
setting priorities in health research and de- 
velopment. The Prime Minister is titular 
head of this council while the committee 
members are Ministers, as well as represen- 
tatives from other government offices and 
the private sector. 


lated through the priority-setting processes 
described earlier. Tables 7a-7c support this 
analysis. 


SAYVCIA 
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nicable diseases (14 percent), and 
health problems associated with 
demographic changes (10 per- 
cent.) The concentration of health 
research efforts on the first area 
arose from concerns on conse- 
quences of industrialization, afflu- 
ence, and influx of migrant work- 
ers. On the other hand, the interest 
in new technologies in health/ 
medical biotechnology, can be 
partly explained by the 
government's increasing emphasis 
on commercial application and 
values of research outputs, which 
is a criterion of IRPA funding. 
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e Iwo other priority areas received 


els is that research capacity in 
less support: occupational and 


terms of human resources and in- 


environmental health at five per- frastructure in these fields is com- 
cent and epidemiological data- paratively limited, and only a few 
base at one percent. A possible such projects were put up for fund- 
reason for these low support lev- ing. 


Table 7a: Health R&D Expenditures by Target Area of the Health Research Priorities for 
Seventh Malaysian Plan, 1998 


Source: COHRED-MOH Health Research Resource Flows Survey, Malaysia, 2000. 
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PHILIPPINES 
health systems, which received sub- 
stantial funding did not belong to the 
ENHR agenda. 


e|n the Philippines, eight of the top 
ten fields that garnered the most 
funding were among the research 
agenda of the Essential National 
Health Research in 1998. Only two 
fields, fundamental research and 


Table 7b: Health R&D Expenditures by ENHR Priorities, Philippines 1998 


«As Table 7b shows, the ENHR list ac- 
tually consisted of 17 priority areas. 


Total Project- 
based 
Funding 
(‘000 US$) 
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Only four of the top ten priorities 
made it to the top ten most funded 
areas. In fact, 9 of the 17 priority 
areas received less than 10 percent 
of research expenditures. More- 
over, devolution, the highest prior- 


ity area, had a share of less than 
half percent. The Philippine Health 
Insurance Program or health care 


financing did not generate any re- 
search interest. 


THAILAND : 
The Thailand study captured the spe- lic Health (MOPH). In table 7c, it can be seen 


cific fields of study for only about US$3 mil- that of the US$3 million subset of MOPH 
lion worth of research in the Ministry of Pub- 


Table 7c: Health R&D Expenditures by Field of Activity by MOPH Priorities, Thailand, 1998 
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Source: COHRED-Chulalongkorn University Health Research Resource Flows Survey, Thailand, 2000. 
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research activities, almost all (97 percent) 
was devoted to Health Economics/Social 
Sciences. Each of the other MOPH priority 
areas had a share of only less than 0.5 per- 
cent. If this is representative of the whole 
picture of research funding allocation in the 
MOPH, there clearly is a need to look into 


processes of funding to support research 
priorities particularly in MOPH which is an 
active participant in setting national re- 
search priorities and which, according to 
Table 5, is the largest user of health research 
funding in Thailand. 


Among the three countries, 
Malaysia emerges as the most successtul 
in aligning financial resources with health 
research priority areas. This may be at- 
tributed to the fact that the government was 
both the main source and the main user of 
health R&D funds. As such, it could wield 


considerable control in directing funding 
into priority areas. On the other hand, the 
diverse sources and users of health research 
funds in the Philippines resulted in health 
R&D finding their way into diverse areas of 
research as well, not necessarily chosen to 
support national priorities. 


Fund Allocation According to Classification of Global Forum for Health Research 


The Philippine study also 
looked into the fund allocation pattern ac- 
cording to aggregate disease categories 
and risk factors as classified by the Global 
Forum on Health Research. The results are 
in Table 8 with the number of identified 
research titles per category shown in the 
second column. The results indicate that 
research in Health Systems and Non-com- 


' The Global Forum for Health Research is a WHO-based intern 
to reflect the global burden of disease, with a focus on effort 


municable diseases have been allotted 
about 50 percent of total funding and 
emerge as the first two categories when these 
are ranked in descending order of funding. 
This reveals a significant shift in funding 
emphasis away from Group | diseases (com- 
municable/maternal/perinatal and _ nutri- 
tional conditions) which occupies the third 
category. 


ational foundation tasked with im i : 
: proving the allocation of health research resou 
s to alleviate the health problems of the poor. “3 
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Table 8: Health R&D Funding and Activity by Aggregate Disease Categories and Risk Factors, 
Philippines, 1998 
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Future Strategies 


Future ofralegt@§ 


The three-country experience in ini- 
tiating the collection and analysis of funds 
flow data for health research has gener- 
ated some initial findings which other re- 
searchers, particularly those from develop- 
ing countries, may want to give attention 


Measurement of Health R&D 


to when embarking on the same effort. 
These findings may also prove useful in for- 
mulating strategies for optimizing the policy 
impact of the research and for encourag- 
ing a sustained data gathering effort. They 
are summarized in what follows. 


e On building a respondent base: de- 
spite the pioneering nature of the re- 
search effort, all three country teams 
were able to build a respondent base 
which generated a relatively high re- 
sponse rate. This was attained mainly 
through purposive sampling, initial 
screening out by telephone, and lever- 
aging, mainly through workshops 
where the questionnaire was discussed. 
Senior researchers in each team also 
brought their own network into the re- 
spondent base, and they proved to be 
very useful for leveraging purposes. 


e A number of follow up phone calls 
were made to respondents not only to 
follow up on responses but also to an- 
swer queries on the questionnaire. 
Most of the questions involved clarify- 
ing definitions and categorizing re- 
search titles. Therefore, use of widely 
accepted definitions and categories 
cannot be overemphasized. However, 
even if the definition is widely accepted 
internationally, it may not be as widely 
known to developing country respon- 
dents, given the pioneering nature of 
the survey. In such cases, it may be 
best to give a definition that could be 
clearly understood by putting it, as 


much as possible, in the context of lo- 
cal practices and norms. 


e Acommon problem that has to be con- 
fronted by a research effort of this na- 
ture is double-counting. The experience 
in this project shows that the effects of 
such a problem could be minimized by 
adopting a flow accounting approach 
where flows through “projects” are iden- 
tified by asking respondents to indicate 
the 1) funds that they received, 2) funds 
that they used and 3) funds that they sub- 
allotted to other institutions. This en- 
ables one to compare responses and, 
in the process, detect inconsistencies, 
thereby allowing for a fairly accurate 
trace of the flow of funds. 


e A common problem faced by respon- 
dents is in digging up the data needed 
to be responsive to the questionnaire. 
This is compounded if multi-year data 
is required. One way to minimize this 
problem is to ask for data on the most 
recent year. 


a The lag time involved in the transmit- 
tal of the questionnaire and in receiv- 
ing the response can become critical es- 
pecially in the face of time constraints. 
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The problem becomes more serious in 
developing countries where mail ser- 
vice could be spotty in some areas. The 
option of using the internet to allow the 


Coordinating Mechanisms for Matching Funds with Priorities 


electronic transmission of responses 
should therefore be explored whenever 
possible. 


One of the more powerful policy 
messages which this research effort deliv- 
ers lies in the comparison between the fund- 
ing allocation pattern revealed by the sur- 
vey with national health research priorities. 
Even just a one-year comparison yields sev- 


eral findings. 


Clearly coordination cannot 
take place without communica- 
tion. In the same way that stake- 
holders and key players must 
somehow ‘be provided opportu- 
nities to come together and be 
“stewarded” by a high level over- 
sight committee to set national 
health research priorities with all 
voices held, results of such prior- 
ity-setting must also be dissemi- 
nated to research funders. They 
in turn will be encouraged to sup- 
port research work on the prior- 
ity areas because of their poten- 
tial national implications. Re- 
search funders can play a big role 


in linking and aligning the think- 
ing of health research 
policymakers and the efforts of 
health researchers. 


In developing priority areas, it is 
better to identify a few rather than 
too many, especially when re- 
sources are limited. A few priority 
areas at least ensures that a fairly 
substantial level of resources can 
be devoted to each. 


Some priority areas are not given 
due research attention not be- 
cause of lack of funding but due 
to the lack of resources required 
to support the needed research, 
in terms of both human resources 
as well as physical facilities. 
Policymakers and_ research 
funders should realize this and 
provide resources not only to con- 
duct the research but also to build 
up the research capability. 
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Sustained Monitoring 


Ideally, the initial research effort 
should serve to encourage main stakehold- 
ers to undertake a sustained monitoring of 
resource flows on a regular basis. It would 
be best if some government ministry such 
as the Department/Ministry of Health or 
Science and Technology would agree to 
allocate funds for undertaking a periodic 
survey. However, if this is not possible, the 
next best thing would be to try to identify 
an existing survey or a potential survey on 
which resource flow questions could pig- 
gyback. 


The survey that feeds into the Na- 
tional Health Accounts (NHA) is one such 
survey. A study of the Philippine and Thai 
situation - where NHA data is already be- 
ing collected - reveals that incorporating re- 
source flow questions would be feasible. 
The next step would be to estimate the cost 
of doing so and present the case before gov- 
ernment policy makers. In the case of Ma- 
laysia which is just developing a framework 
for its NHA, the potential to include the re- 
quirements for tracking health R&D flows is 
even more promising. 
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PART TWO : 


A Manual on Tracking Resource 
Flows tor Health Research 
and Development 


Slee ote oh 
“2 syeC! Ine 


SSIECTIVES 


ee 


This manual is addressed to coun- 
tries that would like to: 

e Identify the sources and uses 
of health R&D funds 

e Estimate the amount-and na- 
ture of health R&D expendi- 
tures 

e Capture health R&D funds flow 
of major players in health care 
sector 

e Perform a qualitative analysis 
of research outputs resulting 
from these resources 

e Assess if health R&D are 
aligned with national re- 


search priorities 

e Compare their results with 
those of other countries that 
have conducted a similar sur- 
vey 


The manual is largely based on the 
collective experience of Malaysia, the Phil- 
ippines, and Thailand in conducting their 
respective country studies. The manual of- 
fers at best a basic approach that will have 
to be customized to meet the needs and situ- 
ations of other countries interested in track- 
ing their resource flows for health R&D. 


FRAMEWORK 


The underlying quantitative frame- 
work of the study uses an accounting ap- 
proach. It very simply traces the flow of 
health R&D funds from fund sources to fund 


The quantitative framework works 
within a qualitative framework that the 
study tries to capture as well. This is the 
structure that theoretically brings together 
health R&D sources with health R&D users 
so that funding is efficiently brought to bear 
on the most critical health research Prior- 
ity areas. This structure usually consists of 


users. Fund users refers mainly to funding 
recipients tasked to undertake the R&D ac- 
tivity. 


both public and private organizations with 
relevant mandates, stakeholders, and the 
larger community. Within this structure exist 
both formal and informal linkages that 
shape the process of formulating policies 
related to the country’s health research 


agenda. 
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DATA GATHERING METHODS 


findings for each method. 


Three main data-gathering meth- 
ods are used. This table shows the expected 


DATA GATHERING METHOD FINDINGS 


Desk Research Respondent Base 
Sources, Users, and Uses of Health R&D Funds 


Amount and Nature of Health R&D Expenditures 
National Health Research Agenda and Priorities 
Health Research Outputs 


Structured Survey Questionnaire Sources, Users, and Uses of Health R&D Funds 
supplemented with telephone/personal Amount and Nature of Health R&D Expenditures 
interviews Health R&D Funds Flow 


Alignment of Health R&D Expenditures with Priorities of 
National Research Agenda 
Health Research Outputs 


Key Informant Interviews with officials of Institutions Involved in National Priority Setting 
relevant organizations Process for National Priority Setting 
National Health Research Agenda and Priorities 


a 


STEPS 


SNe SS El 


To undertake the study, the steps to take are: 


1. Understand Study Components 


The diagram below illustrates how the study components relate to each other. 


Conduct Key Informant 
Interviews for 
Priority Setting Process 


Identify Agencies 
Identify Interviewees 
Design Interview Schedule 
Conduct Interviews 


Conduct Desk Develop Findings 


Research 


Integrate 
—_ > Findings / 
Write Report 


Conduct Survey for Database 


_ Develop the respondent base 
Design the Survey Instrument 
Conduct the Survey 
Process the Data 
Format the Tables 
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2. Translate Study Components into an Activity/Delivery 


Timetable for Scheduling and Monitoring Purposes 


Adjust this generic timetable to your 
country’s needs and situations. Use it as a 
worksheet to flesh out the project workplan. 


TIME PERIOD 
ACTIVITY i 
(esken Ser at DELIVERABLES |RESPONSIBILITY 


Month 2] Month 3 


tion. 


Conduct 
Desk 
Research 


Key Infor- 
mant Inter- 
views for 

Priority Set- 
ting Process 


Agencies 
a. 
Interviewees 
- Design 
Schedule 
i 
Interviews 
- Develop 
Conduct 


Survey/ 
Database 


- Develop the 

Respondent 

Base 

eee | 
the Survey 
Instrument 


- Conduct 
the Survey 


Research Asst. 
(RA) 1, 


messenger 


Monitoring table on 


1. Send out questionnaires 
delivery status 


- by mail 
- by messenger 
2. Follow up responses 
through phone 
- Ensure that target 
respondents received 
questionnaire 
- Clarify repsondent’s 
questions which can be 
answered through phone 


Monitoring table on 
status of feedback 
from respondents 


RA 2, RA3 
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ACTIVITY TASKS 


Conduct 
the Survey 
(continued) 


3. Visit/interview respon- 
dents who need assis- 
tance in answering 

questionnaires 


_ Receive accomplished 
questionnaires 
- by mail 

- by messenger 


_ Check completeness and 
consistency of retrieved 
questionnaires 


. Call respondents by 
phone to clarify unclear 
responses 


. Send out thank you 
letter to respondents 


- Design the 
Database 
- Process 
the Data 
- Format the 
Tables 


TIME ea ee 


(broken down into months or ea ee 


SSC ee 


RESPONSIBILITY 
DELIVERABLES 


Accomplished 
questionnaires of 
visited/interviewed 
respondents 


RA 1, 
messenger 


Monitoring table on 
status of collection/ 
retrieval of 
questionnaires 


Senior 
Researcher 


RA 2, RA3 


Questionnaires with 
marks on unclear 
responses. 


Clean, consistent Senior 
questionnaires Researcher 
ready for encoding RA 2, RA3 


RA 1, 
messenger 


3. Conduct Desk Research 


As a first step, do desk research on 
all available data and statistics about 
health R&D flows in your country. Some 
sources that may be useful are: 


¢ government budgets (national 
and specific departments) 

. annual reports of research in- 
stitutions 

e academic and research journals 

e development plans from the 
economic planning office, and 


e statistical databases. 


You can use secondary data from 
the above sources to estimate the propor- 
tion of health research and development 
against aggregate figures such as gross 
domestic product (GDP), government bud- 
get, resources for health, and resources for 
R&D, to come up with the following table: 
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Summary of Government Sources for Health, R&D, and Health R&D 
(Currency), (survey year/s) 


BUDGET ITEM 


Total Budget 


Resources for Health 
As a % of total budget 


YEAR 1 YEAR 2 


Resources for Research and Development 


As a % of total budget 


Resources for Health Research and 
Development 


As a % of total budget 
As a % of resources for health 
As a % of resources for R&D 


You can also identify the govern- 
ment offices that were given budget items 
for health research and the relative mag- 


nitudes of these. A sample table for the Phil- 
ippines follows: 


Summary of Government Health R&D Allocations 
(Currency), (survey year/s) 


BUDGET ITEM 


Total Health R&D Resources 


1. Department of Health (DOH) 
As a % of Total Health R&D Resources 
As a % of Total DOH Budget 
Total DOH Budget 


Office of the Secretary 
A. Programs 
1. Research Institute for Tropical Medicine 
2. Essential National Health Research 
3. Bureau of Research and Laboratories 
B. Projects 
- Health Status Survey 


Lung Center of the Philippines 


- Comprehensive Research and Development, 
Management, Training and Education for the 
Prevention and Treatment of Lung Diseases 


YEAR 1 YEAR 2 
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continued 


BUDGET ITEM 


National Kidney and Transplant Instiute 


Prevention and Treatment of and Research on 
Kidney Diseases Particularly Those Requiring 
Dialysis and Transplant 


Philippine Children’s Medical Center 
- Comprehensive Research and Development, 


Management, Training and Education for the 
Prevention and Treatment of Children’s Diseases 


Department of Science and Technology 
(DOST) 
As a percent of Total Health R&D Resources 
As a percent of Total DOST Budget 
Total DOST Budget 


Food and Nutrition Research Institute 


Philippine Council for Health Research 
and Development 


Department of Education, Culture, and 
Sports (DECS) 
As a percent of Total Health R&D Resources 
As a percent of Total DECS Budget 
Total DECS Budget 


Office of the Secretary 
- Research and Promotion of School Health and 
Nutrition 


The data you collect will be in your 
country’s currency. However, if you intend to 
compare your country results with those of 
other countries, then convert your currency 
into US Dollars using the pertinent foreign 
exchange rate. 


YEAR 1 YEAR 2 


As a second step and on the basis 
of the desk research, list your country’s fund 
sources and fund users, using the follow- 
ing table as a guide. Usually the major fund 
sources and fund users are those specified 
in the table but in reality, the final list will 


Categories for Flow of Funds 


SOURCES 


Public Funds 
Government Budget 
Social Insurance 


Private Funds 
Pharmaceutical Companies 
Health Care Providers 
Nongovernment Organizations 
(NGOs)/Foundations 


Academic Institutions 


Foreign Agencies 
Bilateral Agencies 
Multilateral Agencies 


USERS 


Government Agencies 
Academic Research Institutions 
NGOs/Foundations 
Pharmaceutical Companies 


Health Care Providers 


$$ 
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differ from country to country. Collapsing 
and/or further delineation of categories is 
the country’s prerogative. For example, if 
pertinent to your country situation, private 
funds can be divided into those sourced 
locally and those sourced from abroad. 


The table will help you identify the 
categories to be used first, in designing the 
survey and second, in processing the data 
to be generated by the study. From the cat- 
egories, you can proceed to identify the re- 
spondents for both the key informant inter- 
views and the survey, 


4. Conduct Key Informant Interviews 


IDENTIFY AGENCIES 


Make a list of all agencies that are 
involved in research priority setting in the 
country. 


These may include 


® government offices 

e non-government organizations 

e academic and research institu- 
tions, and 

e selected private sector groups 
such as_ industry associations for 
doctors, drug manufacturers, and 
hospitals. 


Within the government sector, of- 
fices may range from the ministry /depart- 
ment of health, the national health care in- 


surance company, the economic planning 
group, and public hospitals to local gov- 
ernment units. You can start out with a short 
list of these agencies/groups. As you make 
inquiries with them, you will identify addi- 
tional agencies to add to the list. 


In the three-country study, for in- 
stance, each country started out with the fol- 
lowing lists of institutions likely to be in- 
volved in priority-setting for health research. 
For some of the institutions listed, specific 
sub-units were involved in the agenda-set- 
ting process. On the other hand, some 
turned out not to be part of the priority-set- 
ting process. Many other institutions, groups, 
and councils were subsequently identified 
to have key roles in the health research 
agenda-setting process. 


THAILAND 


MALAYSIA 


Government Offices: 
Ministry of Science, 
Technology and the 
Environment 


Ministry of Health 
- Standing Committee 
for Medical Research 


PHILIPPINES 


Government Offices: 
Department of Science 
and Technology 
- Philippine Council for 
Health Research and 
Development 


National Economic 
Development Authority 


Academic/ 
Research Institutions: 
University of the Philippines 


Government Hospitals: 
Philippine General Hospital 


Government Offices: 

National Research Council of 
Thailand 

Ministry of Public Health 

National Science and 
Technology Development 
Agency 


Autonomous Research 

Funding Organizations: 

Health System Research 
Institute 

Thai Research Fund 

Thai Health Research 
Institute 


Ananthamahidol Foundation 
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IDENTIFY INTERVIEWEES 


IVCWWNTI TE Nee 


From each agency/group identi- 
fied in the listing, find out who the best per- 
son is to interview about the national health 
research priority-setting process. These are 
the people who will serve as respondents 
for the Key Informant Interviews. 


DESIGN_INTERVIEW SCHEDULE 

Use the suggested interview sched- 
ule found below simply as a guide. Adjust 
it according to the requirements of your 
country situation. 


Name of Respondent: 

Institution: 

Position: 

1. What is your institution’s mandate? 


2. Please describe the existing set-up for health re search priority-setting in which your 


organization is involved in. 


a. Institutional set-up 


- different organizations included and their respective mandates 
b. Other stakeholders and the role of each 


c. Processes involved 


d. Linkages among all stakeholders 


e. Criteria for prioritization 


3. From the processes described above, what are the current priorities for health research? 


4. Is there any mechanism for: 


a. disseminating health research priorities? 
b. channeling resources into the priority areas? 


5. a. What problems are encountered in the priority-setting and other related processes for 
health research? 


b. What recommendations can you give to address problems identified in (a)? 


CONDUCT INTERVIEWS 


Be sure to take down notes when you 
conduct the interview. You can also bring 
a tape recorder. Use this only if the respon- 
dent agrees to having the interview tape- 
recorded. Before you conduct the interview, 
identify the most important pieces of infor- 
mation you need so that you can devote 
most of your questions to these. 


DEVELOP FINDINGS 


In developing the findings for this 
section, keep in mind that the overarching 
questions you want answered are: 


Is there a priority setting process in 
place for health research? 

Do all the agencies/officials who 
should be involved in the process 
take part in it? 

What are the channels and mecha- 
nisms for taking part? 


eee eee 


48 


TRACKING COUNTRY RESOURCE FLOWS FOR HEALTH RESEARCH and DEVELOPMENT 


How are the results of the process 
disseminated to interested and 
concerned parties? 

How often does the process take 
place? 


Use diagrams and charts, as 


needed, when you present the findings for 
this section. 


5. Conduct Survey for Database 


DEVELOP THE RESPONDENT BASE 


If this study is being conducted for 
the first time in your country, chances are 
high that you have no idea of the universe 
of respondents. You can start by collating 
lists compiled by main stakeholders. These 
include government agencies such as the 
Ministry/Department of Health or the Min- 
istry/Department of Science and Technol- 
ogy. You can ask them for a list of their re- 
search partners or a list of all the organi- 
zations to whom they have given research 
funds/projects. You can also look into lists 
of private sector groups such as the indus- 
try associations for pharmaceutical com- 
panies, or umbrella groups of research in- 
stitutions. Keep an open mind in develop- 
ing a long list of respondents. The list can 
also expand while you are already con- 
ducting the survey. As you make inquiries 
with your first set of respondents, ask them 
to link you up with other names and orga- 
nizations in their research network. 


When the list gets too long, conduct 
some telephone interviews to find out which 
respondents are worth reaching and get- 
ting into your respondent base. 


SSO pdingcinarisel 0 Ek 


DESIGN THE SURVEY INSTRUMENT 

This is the survey instrument used by 
the first multi-country study. You do not have 
to follow it completely. You can adjust some 
sections to suit your country situation. How- 
ever, if you want to compare your research 
findings with other countries, then it is best 
to stay as close as possible to this survey 
instrument. 


In using this survey instrument, the 
country teams of Malaysia, the Philippines, 
and Thailand have learned many lessons. 
The more important ones are reflected in 
the questionnaire presentation. 


The questionnaire consists of three 
sections: General Information, Research 
Agenda, and Financing and Expenditures 
for Health R&D. In asking for data, ask for 
the data on the more recent year. Compo- 
nents of each section, as well as a sample 
introductory letter and cover page are pre- 
sented in the succeeding pages. 


The sample letter shown here was used for 
the Department of Health target respon- 
dents in the Philippine survey. 


Introductory Letter. Print the introduc- 
tory letter in the letterhead stationery of the 
ministry/department endorsing the study. 


[Letterhead of the Department of Health] 


DEPARTMENT MEMORANDUM 
No. s. [year] 


TO: ALL SERVICE DIRECTORS/ PROGRAM MANAGERS, REGIONAL HEALTH OFFICE DIRECTORS AND 
OORDINATORS OF FOREIGN-ASSISTED PROJECTS 


COORDINATORS OF FOREIGN-ASSISTED FRU 


SUBJECT: Survey on Funds Flow for Health Research and Development 


The Philippines, together with Malaysia and Thailand, is participating in a multi-country study that aims to track 
resource flows for health research and development, with the end in view of developing a basic methodology for 
tracing and measuring health R&D funds as a tool to fine-tune the allocation of health R&D funds in a country. To 
carry out the project, country teams have been formed from the Ministry of Health for Malaysia, the College of 
Public Health of the Chulalongkom University for Thailand, and the Center for ‘iconomic Policy Research (CEPR) 
for the Philippines. The Philippine study is carried out by the CEPR in cooperation with the Essential National 
Health Research (ENHR) unit of this Department. 


As part of the study, a survey is being conducted to collect data on the present level of funding and flow of funds for 
health research in the public sector for the years 1997 and 1998. This replicates a segment of a first survey 
conducted in 1998, which established parallel but more extensive data set for 1996. 


In this regard, you are enjoined to accomplish the attached questionnaire for your respective units, and return the 
same to CEPR, [address], on or before [dd-month-yyyy]. Arrangements for submission to CEPR are indicated in 
the questionnaire. 


For compliance. 
[ Signature | 
[ NAME } 
Undersecretary of Health and 
Chief of Staff 


—$—$— ————— 
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Cover Page. The cover page should con- 
tain a short note on the study’s objectives, 
details of the organization/ partners in- 
volved in the study, as well as specific in- 


structions for the accomplishment and sub- 
mission of the questionnaire. 


SURVEY ON 


HEALTH RESEARCH AND DEVELOPMENT 
RESOURCE FLOWS 
SS eee ee 


This survey aims to obtain information on health research and development 
(R&D) activities of the government and private sectors for calendar years (state 
coverage period). It is particularly designed to gather data on the level and type 
of available financing and expenditures, as well as the process for agenda-setting, 
for health R & D. Results of this survey will serve as inputs to a multi-country 
study that seeks to develop a basic methodology for tracing and measuring health 
R & D funds, as a tool for fine-tuning the allocation of such funds in a country. 


State study back- 
ground and objectives 
here. 


Please accomplish the items in the questionnaire by checking or writing the 

Specific instructions figures in the appropriate box(es). Where complete information is not available, 
for filling the survey please provide estimates with explanatory footnotes or attachments. Please do 
scene) oes not leave any blank spaces. If the information is not applicable, please put N/A. 


The data reported in this questionnaire will be treated in strict confidence and will 

be used for statistical purposes only. 
State partnerships 
and collaboration with 
government institutions 
and retrieval system. 


This survey is being conducted by (name of institution conducting survey), in 
cooperation with the (cooperating agency/ies). Its Staff from (name of institu- 
tion conducting survey) shall be coordinating with your office to arrange the 
retrieval of the accomplished questionnaire. If you have questions regarding this 
survey, please contact any of the persons listed below: 


Contact Persons 
Name of Office 
T i Nas State all contact 
Bi N ee information and names 
GXGINOS:— 2 of key staff/s. 
E-mail Address: 


Please return all completed forms to us before . Your coop- 
eration is very much appreciated. 


i ~~ ry ~ 
BRARY *\o\ 


fer 


n ANO i 

: % \ 4 | } ¢ ) z |] 

\4 > Of INFORMATION y | 

ae CENTRE 4, ff 
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General Information. This section fa- government or private sector, if it . a ae 
cilitates an initial classification of respon- or source of health R&D funds, or It If does 


dent institutions, so that you can identify if not conduct health R&D. 
a respondent institution belongs to the 


Name of Institution/Department: 
Address: 
Mailing Address: 
sss ss aa 


Telephone No: Fax No:: 


Person(s) Completing This Form: 


Part Printed Name Signature Job Title Tel. No. 


I. GENERAL INFORMATION 
Item 1. Type of Institution 


Cc) Government 


&) Private 


C) Others (please specify) 


Item 2. Type of Health Research and Experimental Development (R&D) Undertaken by This 
Institution 


C) Internal ( type of R & D that is performed within the particular institution/ 
department/unit) 
C Basic Research 
oe Research 
Experimental Development 
(External ( commissions another institution/department/unit to perform health 
R&D) 


C ) Both Internal and External 
C None of the above (Survey ends. Please return questionnaire) 


* if answer is internal, external, or both, proceed to the next item. 


DEFINITIONS 


R&D — any systematic and creative work undertaken in order to increase the stock of knowledge, 
and the use of such knowledge to devise new applications. 

Basic Research — any experimental or theoretical work undertaken primarily to acquire new knowl- 
edge of the underlying foundations of phenomena and observable facts, without any particular or 
specific application or use in view. 


Applied Research — any original investigation undertaken in order to acquire new knowledge that 
is directed primarily towards a specific practical aim. 

pr Development — any Systematic work, drawing on existing knowledge gained from 
research and/or practical experience that is directed to producing new materials, products and 


devices to installing new processes systems and f vi ir T pr OV ir ig S 


Lee 
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Research Agenda. The objectives of this 
section are to find out whether the respon- _ sulted in its own agenda-setting, and to 


dent institution follows an agenda for identify other factors that influence its 
health research, whether the national re- agenda-setting. 


search agenda for health research was con- 


Il. RESEARCH AGENDA 


Item 3. Is there an agenda for health research for your institution for [state period]? 


C Yes. o) No. 


Item 4. a. Do you undertake R&D in fields other than health? 


C Yes. C No. 


b. If yes, what are these other fields? 


Item 5. Did you consider the national health research agenda (see box below) in formulating your own 


agenda? 
Ze 


Yes. No 


Item 6. What are the other factors you considered in the formulation of your institution’s health 
research agenda? 


National Health Research Agenda 
Institution/Department’s own objectives 
Degree of necessity/requirement 

Others, please specify 


NATIONAL HEALTH RESEARCH AGENDA 
(Period Covered, e.g. 1996-2000) 


For your respondent's reference, it may be useful to enumerate here your country’s 
national health research agenda which you gathered from: 


© official statements 
e official publications 
e key informant interviews 
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Financing and Health R&D Expendi- sented below and in the succeeding tables 
tures. This section traces the sources, us- are parts of the questionnaire addressing 
ers, and uses of health R&D funds. Pre- the main objectives of the study. 


IIA.1. Financing Health R&D, (survey year). 


Item 7. Source of funds for Health R&D Expenditures by Agency/Institution, (for internal R&D, 
external R&D or both) 


SOURCES OF FUNDS 
by Agency/Institution 
The respondent 


Cee mucous i 
sources of funds in the \_ A. INSTITUTION’S OWN FUNDS 


AMOUNT 
UTILIZED 


Pe Figures unde? 


AMOUNT 
RECEIVED 


frst column, while the 
corresponding amount 
received and uted for [DOH 
Serassrdcetn [post 


the second and third 
columns. 


Academic/ Research 
Institutions (pls. specify) 


Hospitals (pls. specify) 


Other Gov’t Inst’ns (pls. specify) 


2. PRIVATE (TOTAL) 


Academic/Research Institutions 
(pls. specify) 


— 


Hospitals (pls. specify) 


NGOs (pls. specify) 


Other Private Sources 
(pls. specify) 


3. FOREIGN FUNDS (pls. specify) 


4. OTHER SOURCES (pls. specify) 


: “amount received” 
Pharmaceutical Firms and “amount utilized”, 
(pls. specify) may or may not tally 

depending on the expen- 
diture patterns of an 


INSTRUCTIONS 


For Internal R&D, proceed to Section III.A.2. 


For External R&D, proceed to Section III_A.3. 
For both answer all following sections 
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Health R&D funds utilized refer to funds that _ tal figure under “Amount Utilized” should 
were either expended for internal research — also be equal to the sum of total internal 


(within the institution) or commissioned out ex i 
on) penditure and total external e 
to other research institutions. Thus, the to- coe 


I1I.A. Internal Expenditure for Health R & D, (survey year). 


Item 8. Total Internal Expenditure for the performance of Health R & D by Fi Vi 
y Field of Activity and by T f 
R&D Activity (only if applicable), (survey year) : — 


FIELD OF ACTIVITY 


TOTAL INTERNAL HEALTH 
R & D EXPENDITURE 


In the multi- 
country study, the 
country teams of 

Malaysia, Thailand and 
the Philippines decided to 
collapse their “field of activity” 
into Natural Sciences, Medical 
Sciences, and Health Econom- 

ics/Social Sciences. You 
may adopt whichever of the 

two is more suited to your 


country setting or you may 4 2. Epidemiological Research 


 wrlalbebteahdeais Saag ls. specify research title: 
classification system. pls. specify 1ue: 


1. Natural Science Research 
( that has benefits for Health) 
pls. specify research title: 


Clinical Research 
Pls. specify research title: 


there were quite a number of respondents 
who had difficulty answering this section 
because there was not enough space provided for 


project titles. Some respondents attached sheets 
itemizing research projects, while others just included 
the subtotals. For the study’s purposes, it is best to 
list project titles to ensure no double counting 
occurs and to provide flexibility for further 
classification. eo 


4. Biomedical Research 
Pls. specify research title: 


o address the 
above problems, 
you may opt for the 
proposed alternative 
format (presented in p. 57), 
which provides a more 
straightforward layout. All 
information is tagged on a 
project basis, to simplify 
encoding, tallying, as well 
as filling out the questionnaire. 
It also provides a check for 
double counting and leaves 
room for further 
classifications 
of project titles. 


Social Sciences Research 
Pls. specify research title: 


Others , pls. specify titles: 


Natural Sciences - concerns the treatment of Natural Phenomenon like Biology, Botany, Chemistry, Physics, etc. as applied 
to health (e.g. studies on bacteriology) 

Epidemiology - study of distribution and determinants of health-related states and events in specified populations and 
applications of this study to the control of health problems. (e.g. India-Long-term effects of exposure to methyl 
Isocyanade) 

Clinical Research - studies, trials, and/or experiments regarding different illnesses and diseases conducted for the benefit 
and with the use of specific patients. (e.g. Pressure lowering effect of Lathanoprost versus Timulol in glaucomatous and 


ocular hypertensive patients.) 
Biomedical Research - studies in living organism with a medical purpose which include diagnosis, therapy, and 
rehabilitation like Chemistry, Pharmacology, Biochemistry, etc. (e.g. Therapeutic properties of Herbal Medicine) 


Social Sciences - studies that are concerned with behavioral patterns or changes in a population as subject to certain 
conditions, situations or phenomena. (e.g. Effects of Religion on Family Planning Practices) 
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Item 9. Internal Expenditure for the Performance of Health R&D Activities by Type of Expenditure, 
(survey year/s) 


Major Equipment 
see 
NOTE: Breakdown of expenditures 
by expenditure type proved too difficult for 
respondents to answer. You may or may 
NOTE: 
LABOR COSTS are measured in terms of the level of effort, interpreted as the proportion of 


not want to include this analysis. 
working hours actually devoted to the conduct of Health R&D as against the nominal wage (e.g. 


Employee is commissioned 10,000 currency units a month and is expected to work 8 hours a day 
on health R&D. However, he/she only works 4 hours a day. Therefore, 1is/her nominal wage is 
halved according to actual work performed, i.e.5,000 currency units. This will be recorded as the 


labor cost.) 


111.A.3. External Expenditure for Health R & D, (survey year/s). 


Item 10. Please give the name and type of the institutions/entities/individuals given financial grant for performance 
of Health R&D activities, contact person/number of the institution/s, and the specific amount given. 


PERSON/NUMBER INSTITUTION FINANCIAL GRANT 
ee = = 
you should emphasize in your survey 
ee ee ee instruction that the sum of total external health rer 
R&D and total internal health R&D should balance 


INSTITUTION TITLE OF AMOUNT GRANTED TYPE OF FIELD OF ACTIVITY 
PROJECT/STUDY (IN PhP) R&D ACTIVITY (see categories in item 8) 


S| 


NOTE: BA Basic Research 
AR Applied Research 
ED Experimental Development 
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Based on the experience of the first 
multi-country study, an alternative format 
to the section on Financing and Health 
R&D Expenditures is proposed. The alter- 
native format provides a more straight- 
forward accounting. All information is 


tagged on a project basis, thus simplifying 
the processes of filling up the questionnaire, 
as well as encoding and tallying. It also 
helps eliminate double counting and allows 
the further classification of project titles. 


Alternative Format for Determining Internal Health R&D 


PROJECT SOURCE OF TOTAL AMOUNT AMOUNT AMOUNT AMOUNT TYPE OF FIELD OF 
DURATION FUNDS* PROJECT RECEIVED UTILIZED RECEIVED IN | UTILIZED IN R&D** R&D*** 
(mm-yy to mm-yy BUDGET TO DATE TO DATE SURVEY YEAR|SURVEY YEAR 
Cate- 
gory 
— i = 
In this format, it is better to ask for 
more comprehensive information on each projec 
research. These include data on duration of project, 
source of funds, total project budget as well as 


= current receipts and disbursements. 


~~ 
Zz 
2 
m 
(o} 
XY 


In applying this format, 
better confidence on the col- 
lected data is gained in terms of 
consistency and reliability. 


FIELD OF 
R&D*** 


CONTACT 
PERSON/ 
NUMBER 


PROJECT 
DURATION 
(mm-yy to IN SURVEY 


PROJECT 
TITLE 
mum-yy) YEAR 


oe ee | ele Ua ee 
gory 
For determining both ~ 
internal and external health R&D 
_——l 
This is most appro- 
/ 


it is better to keep an open-ended 
table which can be filled up in 
ate if you assess that 
most of your respondents 


no particular order. 
do not have good recording 


mx. 
ystems of their health re- 


search funds flow. 
* Source of Funds 


“*Type of R&D 
1- Basic Research 


1- __Institution’s own funds cane h 

2- Department of Health 74 Applie esearc ***Eiold of R&D 

3- Department of Science and Technology 3- Experimental Development Fae Natural’ Saeneee 
4- Government academic/research institutions Medical ‘Sciences 
5- Government Hospitals vF 3- Health Economics/ 
6- Other Government Institutions Social Studies 


7- Pharmaceutical firms 

8- Private academic/research institutions 
9- Private hospitals 

10- NGOs 

11- Other private sources 

12- Foreign funds 

13- Other sources (pls. specify) 
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CONDUCT THE SURVEY 


LYNE ES 


Your success indicator for this part the project and questionnaire. 
of the study is the response rate you will e Mailing out questionnaires fol- 
get for your survey. You can use different lowed by telephone call. 
techniques to get a high response rate. e Whenever time and resource 
e Getting a high level official to will permit, conducting per- 
“champion” your work, sign sonal interviews with those who 
your introductory letter, and account for large amounts of 
attend your workshops/meet- health research funding . 
ings. 
e Providing incentives to enlist Once your survey is ongoing, you 
the participation of the private can use monitoring tables to assess its sta- 
sector. tus. 


e Holding meetings to explain 


Projected Schedule of Activities 


ACTIVITY RESPONSIBILITY 
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A summary table of the respondent 
base is one of the tools you will need to 


There should be a 
periodic update of the 
Survey status. Information 
presented should be set 
against the respondent 
base. 


Total No. of Respondents 


|. Department of Health 


a. Central Office 

b. Special Projects 

c. Specialty Hospitals 

d. Special Hospitals 

e. Medical Centers 

f. District Hospitals 

g. Research Hospitals 

h. Regional Health Offices 


Ww 


BD WANW WwW NY 


lV. Academic Research Institutions 
a. University of the Philippines, Manila 
b. University of the Philippines, Diliman 


V. Hospitals 
a. Philippine General Hospital 
b. Veterans Memorial Medical Hospital 


While the above summary table 
provides an overall status of the survey, you 
need to supplement this with a more de- 


tailed monitoring tool. A more detailed 
table is needed to keep track of all the in- 
stitutions included in your respondent base. 
All institutions surveyed should be system- 
atically listed in this table following the cat- 
egories indicated in your framework 
(Framework and Categories for Flow of 
Funds). Once a questionnaire Is submitted, 
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Summary of Questionnaire Collection 
As of October 1999 


keep track of the progress of the survey. A 
sample table is presented below: 


COLLECTED AS OF 
= 0/19/1999 


30 
0 
3 
5 
6 
2 
] 

13 


it should immediately be given an ID. This 
results in more efficient tracking, process- 
ing, and management of both the physical 
and electronic databases. Assigning IDs is 
also a must for confidentiality purposes. 


Aside from a listing of all institutions 
surveyed, the detailed monitoring tool 
should contain (1) the name of the person 
to whom the questionnaire was addressed; 
(2) date of delivery; (3) name of person who 


received the questionnaire (if data Is avail- 
able); (4) name and number of contact per- 
son for follow-up; and (5) dates of activi- 
ties/events pertaining to the status of the 
survey, e.g. stated date for pick-up, date of 


receipt of accomplished questionnaire, 
date when responses have been encoded 
or double-checked, etc. You can devise a 
detailed monitoring tool similar to that in- 
dicated below. 


Respondent Monitoring Table 


Institution Head Delivery 


2. Bureau of Food Dr. 7/13/99 
and Drugs 


DESIGN THE DATABASE 


In designing the database, two 
things are planned out: the contents and the 
container. Here, you have to make sure that 
a systematic housing of the data is 
achieved. In order to do this, data need to 
be properly labeled and cleaned. Likewise, 
inside the house data should be systemati- 
cally assigned appropriate places. A dis- 
cussion on how to design the contents and 
container of the database follows. 


Contact 
person/ 
number 


Tess Santos As of 7/23/99 | 7/25/99 
23-7382 | 7/19/99 


1. Food and Nutrition | Dr. 7/13/99 
Research Institute 


Date 
Encoded | Double 
4 checked 


Date 
Collected 


rs 
7/28/99 


p= 
PT 
This table may be 
utilized for monitoring the 
progress of different phase 
Lo of a survey, i.e., question- 


naire distribution and col- 


Te siege data proces- 


Assign alphanumeric codes to the 
contents. Before processing the data, it 
is advisable to assign numeric codes to re- 
spondents, variables and responses. In 
general, numeric codes are utilized in da- 
tabases because they provide greater effi- 
ciency, in terms of data retrieval, minimiz- 
ing encoding time and errors, as well as 
disk space utilization. They also facilitate 
a systematic and efficient way of storing, 
processing, and managing data. 


ee TS 
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» Respondents. As discussed ear- 
lier, the IDs assigned to respondents 
should follow the categories in your 
framework. For example, your cat- 
egories consist of the government 
and private sector, under which sev- 
eral institutions have been identified. 
In assigning IDs make sure that the 
ID will systematically classify an in- 
stitution. You could make an alpha- 
numeric code to incorporate all clas- 
sification: for example all institutions 
under the government sector are 
given IDs beginning with “1”; if the 
institution is under the DOH, it is as- 
signed “01”; since there are several 
divisions within the DOH, Central 
Office institutions are assigned “A’; 
all institutions are then alphabetically 
arranged under each subgroup; thus, 
in the above table the ID assigned to 
the Bureau of Food and Drugs is 


101.A.02. 


This system is crucial in aggre- 
gating data. It allows you to take one 
look at the ID and immediately iden- 


tify its grouping. 
= Variables. Each question in the 


survey form is considered a variable. 
Codes should also be assigned to 


VARIABLE COLUMN 
NUMBER NUMBER 


= 45 
et 
ae 4 


ITEM DESCRIPTION CODES 
NUMBER 


_ Se, ee SS 
SS SSS 
m we 


each variable. Alphanumeric vari- 
able codes allow you to store ques- 
tionnaire data in a more systematic 
and efficient way, particularly in cases 
where a question is quite long. For 


example, if you want to store data for 
the question: “Is there a health research 
agenda for 19972” instead of encod- 
ing the entire question as a variable, 

you could label it as “V5” instead (fol- 

lowing the sequence of questions). 


» Responses. In the same way that 
questions need to be translated into 
alphanumeric codes, responses to 
questions in the survey should be 
coded, specifically categorical re- 
sponses. To illustrate, in the previous 
example, the question: “Is there a 
health research agenda for 19972” 
can be answered by a “yes”, “no” or 
“not applicable”, however, instead of 
encoding these, you could assign the 
following codes thus: “O = No”; “1 = 
Yes”; “88 = NA’. This minimizes da- 
tabase space consumption to two dig- 
its, which translates in less encoding 
time and is less prone to encoding er- 
rors. The value of coding responses 
becomes more evident as responses 
become more complex. A sample 
coding system follows. 


1 - Government 
2 - Private 
3 - Others 


Respondent ID 


Type of Institution 


1 - Internal 
2 - External 

3 - Both internal & 

external 

4 - None of the above 
81- No information 
—__ EEE) SS 
Type of internal 1 - Basic Research 
health R&D 


Type of Health 
R&D undertaken 
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] 


VARIABLE 
NUMBER 


v4 


(continued) 


Build the container. The container of 
your data can be built in any spreadsheet 
software. Rows and columns comprise the 
database container. Rows refer to each 
case or respondent, with each particular 
row containing the responses of a particu- 
lar institution. Thus, each row is labeled 
by the assigned respondent’s ID. Columns 


2 - Applied Research 
3 - Experimental 
Development 
4-1&2 
5-283 
6-18&3 
7 Vie 
81 - No information 
88 - NA 


Is there health research 
agenda for 1997, 1998 
and in the next 3 to 5 
years? 


81 - No information 
88 -NA 


pertain to each variable or question in the 
survey form. Each column contains all the 
responses of all surveyed institutions to a 
particular question. A variable ID is as- 
signed to each column. These variable IDs 
sequentially correspond to the questions in 
the survey. 


Sample Database Table 


Rows refer to 
each case or 


responde 


Each row is 
labeled by an 
assigned 
respondent ID 


to each variable 
or question in the 
Ss 


Encoding. Once codes are assigned to 
respondents, variables, and responses, you 
can proceed with encoding. Data can be 
encoded in any spreadsheet or database 
software, depending on the capabilities of 
your research staff. In the case of Thailand, 
data was encoded and processed using MS 


a 
A Variable ID is 
assigned to each column 
which sequentially corres- 
‘ ponds to questions in the ‘a 


Excel; for the Philippines, a combination of 
MS Excel and MS Access was utilized; while 
Malaysia supplemented their spreadsheet 
sofware with SPSS-Teleforn, which has the 
capability of scanning responses and auto- 
matically encoding data. 


SS MMM Ee 
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Sample Database Table with Alphanumeric Codes 


vl 
(Respondent | 


101.A.01. 
101.A.02. 
101.A.03. 
101.A.04. 


PROCESS THE DATA 


In terms of minimum software re- 
quirements, MS Excel is sufficient to pro- 
cess the survey data, especially since the 
bulk of the analysis requires the check and 
balance tools available in such a spread- 
sheet solution. In aggregating institutions, 
as well as getting the subtotals of catego- 
ries, the filter function of MS Excel is suffi- 
cient, albeit a bit slow since each category 
for each grouping would have to be filtered. 
An alternative to this is to use MS Access to 
get subtotals for each category for each 


Target Output Variables 
Needed 


Users of Health R&D 


V40, V84 1 
be 
3. 


Database of health 
research projeacts 


Uses of Health R&D 


Alphanumeric codes 
are encoded to represent 


categorical variables 


Sources of Health R&D V11-V24 1. Get the subtotal of the amount received (V1 1-V24) by all respon- 
dents from each institution category. 


Assign all institutions commissioned by respondents to do R&D 
(external R&D) to their respective institution category, using your 
existing alphanumeric codes. In effect, institutions tallied as 
“users” are those conducting the actual research. 

Filter respondents by institution category (based on your frame- 
work), i.e., in MS Excel, using the filter command, select one 
institution at a time, DOH, then DOST, etc. 

Get the subtotal of the internal health R&D expenditure of all 
respondents under a particular institution category. Note that 
outsourced projects are tagged as internal health R&D of com- 
missioned agencies. 


1. Check the different classification of health R&D (type, field, Glo- 
bal Forum) by reviewing project titles against given definitions. 
2. Correct or re-classify project titles. For additional classification 
systems, such as the Global Forum, each project title needs to be 


reviewed and classified accordingly. 


However, this needs familiarity 


grouping. 
with MS Access in order to be able to ma- 


nipulate the necessary commands. If your 
research staff are not knowledgeable in MS 
Access or SPSS, it is best to keep to MS Ex- 
cel, especially since MS Excel features can 
do the task. 


For the analysis, a listing of data 
processing procedures follows, vis-a-vis 
variables needed and target output. The 
reference variables based on the survey in- 
strument are given in the next table. 


Data Processing Procedure 
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Compute the subtotals for each category of each classification 
system. 


Uses of Health R&D 


(continued) 


1. Filter respondents by institution category. 

2. To trace the fund sources of a particular institution category, get 
the subtotals of the amount received (V11-V24) by the filtered 
institution category from each institution category. Sum all funds 
received by filtered institutions and get percentage distribution 
of funding received from each institution category. Repeat for 
all institution categories. 

3. To trace the fund users of a ; articular institution category, get 
the subtotal of health R&D expended internally by the filtered 
institution category. This figure represents funds used by this 
category. Tally all the outsourced projects of this filtered cat- 
egory by institution category. Add the two figures to get the 
total health R&D expenditure of the filtered category. Get per- 
centage distribution of health R&D funds expended both inter- 

nally and externally. 


V11-V24 


Funds Flow 


Classify project titles according to national health research 
agenda categories. If a project does not fall under any of the 
set agendas, create a category that defines its theme. 
Compute the subtotals for each category. 

Sort the subtotals in descending order. Get percentages. 
Indicate the ranking of categories included in the national 
health agenda. 


Database of 
of Health 
Research 

Projects 


Alignment of Health R&D 
Expenditures with 
National Health 
Research Agenda 


RwN 


Reference Variables 


AMOUNT RECEIVED AMOUNT UTILIZED 


SOURCES OF FUNDS 
by agency/institution 
Vv10 


Dt CO Ti i 

PD RGOVERNMENT (IORAMEN |. 

oO Di nn es ae 
DOST V28 


Academic/ Research 


Institutions (pls. specify) NTS v29 


Hospitals (pls. specify) 


Other Gov’t Inst’ns (pls. specify) 


2. PRIVATE (TOTAL) 
Pharmaceutical Firms (pls. Specify) 


V18 Wd 


Academic/Research Institutions 
(pls. specify) 


— V19 
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continued 


SOURCES OF FUNDS AMOUNT RECEIVED 
by agency/institution 
v10 


AMOUNT UTILIZED 


Hospitals (pls. specify) 


NGOs (pls. specify) 


Other Private Sources (pls. specify) 


3. FOREIGN FUNDS (pls. specify) 


4. OTHER SOURCES (pls. specify) 
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FORMAT THE TABLES 


can already input these in tabular format. 


Once you have processed the data 
You can use these dummy tables as a guide. 


and computed the subtotals and totals, you 


Respondent Base and Respondent Rate of Health R&D Survey, 
(survey year/s) 


Number of 
responses 


Response Rate 
% 


Number of 
questionnaires sent 


TYPE OF INSTITUTION 


Private Voluntary Organizations 


Eee 
————— = Tell 
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Number of Respondents With and Without R&D Expenditure, 
(survey year/s) 
Without Health 


No. of With Health R&D Expenditure 
INSTITUTIONS Respondents w/ Date ie Data R&D Expenditure 


TOTAL 


Government Sector 


Year 2 


Department of Science and Technology 


Department of Education, Culture, and Sports 
Academic Institutions 


Hospitals 


fe) iw) 
> . 
® re) 
a a1 
3 
® 
2 
° 
LE 
pe if 
@ 
o 
= 


Private Sector 


Pharmaceutical Firms 


Academic Institutions 
Hospitals 

NGOs 

Others 


Foreign Sector 
UN System 
Development Banks 
Bilateral/ Multilateral 
Private Foundations 
NGOs/PVOs 


Academic/ Research Institutions 


Pharmaceuticals 
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Sources of Health R&D Funds, (survey year/s) 
(currency) 


1. Government Sector 
Department of Health 
Department of Science and Technology 
Department of Education, Culture, and Sports 
Academic and Research Institutions 
Hospitals 
Others 


Il. Private Sector 
Pharmaceutical Firms 
Academic and Research Institutions 
Hospitals 


NGO's 
Others 


Ill. Foreign Sector 
UN System 
Development Banks 
Bilateral Agencies 
Private Foundations 
NGO /PVO 
Academic / Research Institutes 
Pharmaceuticals 


Others 


Users of Health R&D Funds, (survey year/s) 
(currency) 


SECTOR 


|. Government Sector 
Department of Health 
Department of Science and Technology 
Department of Education, Culture, and Sports 
Academic and Research Institutions 
Hospitals 
Others 


Il. Private Sector 
Pharmaceutical Firms 
Academic and Research Institutions 
Hospitals 
NGO's 
Others 


Ill. Foreign Sector 


TOTAL HEALTH R&D FUNDS 
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Health R&D Expenditure by Type of Activity and Field Activity, 
(Survey year/s), (currency) 


; Experimental Total Health R&D 
Basic Research Applied Research Development Expenditure 
Yeor 1 | Yeor 2 | Yeor Yeor [Amount J 


Type of R&D 
Activity 


D 
[iomediclteseoen | | | 
[eincalReseoreh || | 
[esideristegy | | | 
[Netwrat scence [| | 

pe |) all aia 
ie soo a 
See a Ae 


Field of 


Sociological Science 
Others (pls. specify) 
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6. Develop Findings 


SOURCES, USES, USERS 


Develop findings from the output 
tables generated. You may present the re- 
sults in charts to emphasize percentage con- 
tributions. 


For the sources table, some findings 
you may be interested to look at are: 


e Comparisons between govern- 
ment and private sectors, 

e Comparisons between local 
sources and foreign sources, 

e Comparisons among institutions 
within each of the government 
and private sectors, 

e Trends across years. 


You can analyze the users table in 
a similar manner. 


For the uses table, you can make 


comparisons among the fields of activities, 
types of research activities, and other clas- 
sifications. Trendsetting across time may 
also reveal important findings. 


FUNDS FLOW 


The data you generate can also be 
processed to determine flow of funds at the 
institution level. On one end, this flow shows 
the sources broken down by institution of 
health R&D funds going to the institution. 
On the other end, it gives the breakdown of 
who used the funds that the institution de- 
clared as having utilized, whether by itself 
or by channeling it to other users. 


This type of funds flow accounting 
usually results in some discrepancies since 
fund use is accounted for on a project basis 
whereas fund source is accounted for in 
more aggregate terms. However, it still pro- 
vides enough information to be useful. 


eS ee 
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SOURCES 


Own Funds 
28.99% 


Other ae Units (State institutions 
6.62% category) 
(Survey year) 


DOST Funds Received: 
0.32% (Currency) 
Project Funds: 
(Currency) 
Foreign 
Institutions 
64.08% 


Depending on the 
format used for determining 
health R&D funding and on the 
answers given by respondents, these 
figures may or may not tally. Should 
reported funds received not equal the total 
of project funds received, it is better to 
indicate and explain these two figures. 
As illustrated, the sources side explains 
where the reported “funds received” 
came from, while the users side 
indicate where they go. 
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USERS 


DOH 
47.2% 


Private Hospitals 
0.1% 


Government 
Academic/ 
Research 
Institutions 
14.2% 


Government 
Hospitals 
3% 


Other 
Government 
Institutions 
0.5% 


Private 
Academic/ 
Research 
Institutions 
8.4% 


NGOs 
23°9% 


Other Private 
Institutions 


0.3% 


Foreign 
Institutions 
3.2% 


7. Integrate Findings/Write Report 


To best appreciate the results of the e How do health R&D funds move 
study, you can relate the findings of one from source to user in the major 
section to the other so that overall patterns health R&D institutions? 
can emerge. You will be able to answer 


questions such as: You can also see the value put on 


health R&D as you assess it as a proportion 


e Who are the main health R&D of selected macroeconomic variables such 
sources? as gross domestic product, government 
e Who are the main health R&D budget for health, and government budget 
users? for research and development. 
e What kind of health R&D is un- 
dertaken, in terms of type as well Finally you can find out if health R&D 
as field of activity? is informed by the national health research 
e What are the magnitudes in- priorities through the following table. 


volved in health R&D? 


Ranking of Health R&D Expenditures by ENHR Priority, (survey year) 


Rank in 
National Health R&D Health R&D 
% Expenditures Expenditures Projects 
(local currency) (foreign currency) Identified 
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Another benchmark you may want to use is the Global Forum Classification. 


Health R&D Expenditure by Global Forum Classification, 
(survey year) 


No. of 


Globel. Feren Total Project-based Total Project-based No. of Projects 
Classification Percentage|Funding (local currency) Funding (USS) Halil with Funding 
entifie 


Group |: Communicable/ 
maternal/perinatal and 
nutritional conditions 


Group II: Non-communicable 
diseases 


Group Ill: Injuries 


Risk factors |: Proximate 
determinants of ill health 


Risk factors II: Distal 
determinants of ill health 
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Sustaining the Effort 


You will gain a better understand- 
ing of your country’s health R&D flows if 
you see its behavior through the years. 
Thus, the interest in finding an organiza- 
tion or mechanism within a country that can 
house and sustain the effort to track these 
flows. 


In most countries, the mechanism 
that may work best is the National Health 
Accounts (NHA). This is usually in the form 
of a matrix that shows how much was spent 
for health care, who paid for health care, 
and what was paid for. It may be spear- 
headed by the Department of Health, the 
National Statistics Office, or some other 
government agency. 


Find out whether your country does 
prepare a National Health Accounts. If yes, 
find out whether the data gathered include 
categories for health R&D. These may be 
stand alone categories or may be part of 
other categories. For example, in the first 
phase of the 1994 Thai National Health 
Accounts, health research and training were 
lumped together with all other health ex- 
penditures. Some categories may not be 
available. in the Philippine National 
Health Accounts, no accounting is made 
of health research spending of private and 
non-profit institutions. 


ee Ut 
_OTHER |SSUES 


In both cases adjustments need only 
be made. These adjustments may include 
some or all of the following: 


© Identifying additional data require- 
ments (be sure that the use and un- 
derstanding of definitions are clear) 

e Sourcing additional data require- 
ments (you can explore the possibil- 
ity of including riders in existing sur- 
vey efforts or mounting surveys dedi- 
cated to tracking health R&D flows) 

e Collecting additional data require- 
ments (compliance of the respon- 
dents will differ depending on who 
is administering the survey) 

e Analyzing the data as standalone 
health R&D flows, as well as in the 
context of the country’s overall 
health sector statistics and other 
macroeconomic data 

e Putting the data in information sets 
for easy use of policymakers. 


If your country does not prepare a 
National Health Accounts, then you may 
have the opportunity of defining ENHR funds 
flow tracking requirements when a frame- 
work for such is developed. 
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Disseminating the Findings 


Make sure that the results of your ¢ Publication of study findings/ 
study are accessible to policymakers, study abstracts in print and 
stakeholders, and relevant players in your electronic media for distribu- 
country’s health care sector. tion 
Some steps you can take to ensure this fol- ¢ Inclusion of study and selected 
Ow: findings in Internet-based da- 


tabases on health research 
¢ Conduct of workshops at vari- 


ous levels (top level, middle You may also want to create a for- 
level, frontline) and with differ- mal Steering Committee for the study that 
ent sectors (legislators, aca- can steward it from start to finish. As the study 
demic and research comes to a close, the Steering Committee 
institutions,government can organize the workshops and see to it 
policymakers, health care pro- that they are attended by people who can 
fessionals, pharmaceutical in- bring the findings to appropriate action. 
dustry) to discuss study find- 

ings 
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